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(57) A method for adding personal image metadata 
to a collection of images including the steps of: config- 
uring, in response to user's answers to predetermined 
queries prior to image capture, a database of pre-as- 
signed metadata labels useful for classifying future im- 
ages, wherein at least one pre-assigned metadata label 
has a label identifier relating to emotional or aesthetic 
judgment of a user of the database; storing the database 
of pre-assigned metadata labels in a digital memory; 
displaying the collection of images that have been cap- 
tured by the user, and a menu for selecting the pre-as- 
signed metadata labels; selectively assigning at least 
one pre-assigned metadata label to at least one digital 
image in response to user's input; and storing the label 
identifier of the selected metadata label in association 
with the selected digital image. 
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Description • 

[0001] The invention relates generally to the field of 
photography, and in particular to collecting and catego- 
rizing images. More specifically, the invention relates to 
a personal database of metadata labels constructed pri- 
or to image capture. 

[0002] Image metadata is well-known, and is useful 
in retrieving desired images from a large collection of 
images. The Kodak DC265 camera formulates many 
metadata items, such as the date/time, camera lens set- 
ting, scene light level, etc. when the picture is taken, and 
stores this metadata within the Exif/JPEG digital image 
file. Unfortunateiy, this metadata cannot identify the sub- 
ject of the photo, or whether this particular photo is one 
of the user's "favorite" photos. It is this latter type of in- 
formation that is most useful in quickly and easily retriev- 
ing desired images from a large collection of pictures. 
[0003] Many software applications allow the user to 
manually type in text, such as a "picture title" or "picture 
description", and store this text within the image file. 
This could be used to add a description including the 
people, events, or type of photo. The text strings from 
ail images in the database could later be searched to 
retrieve images having the names, events, etc. of inter- 
est. Unfortunately, this is an extremely tedious method 
of adding metadata. In addition, since the user may type 
in different text to describe the same item (e.g. Matt, 
Matthew, or X-mas, Christmas) the database may not 
contain consistent names for the same picture catego- 
ries. Some particular software applications, such as Im- 
age Expert 2000 developed by Sierra Imaging Inc., al- 
low the user to add keywords to captured images. The 
keywords are categorized as "location", "occasion", 
"photographer", and "subject". While viewing a group of 
thumbnail images, a user can create keywords in these 
categories and assign the keywords to one or more cap- 
tured images by selecting the thumbnails and keywords. 
The keywords from all images in the database can later 
be searched to retrieve images that were assigned to 
those particular keywords. 

[0004] Unfortunately, these conventional software ap- 
plications make it difficult for an untrained consumer to 
categorize their images in a way that enables them to 
later locate their favorite images of a selected subject. 
What is needed is a simple, fast method for the user to 
add emotional or aesthetic based type metadata to a 
collection of images, and to use this emotional or aes- 
thetic based metadata to retrieve images of interest. 
[0005] The present invention is directed to overcom- 
ing one or more of the problems set forth above. Briefly 
summarized, according to one aspect of the present in- 
vention there is a method for adding personal image 
metadata to a collection of images including the steps 
of: configuring, in response to user's answers to prede- 
termined queries prior to image capture, a database of 
preassigned metadata labels useful for classifying fu- 
ture images, wherein at least one pre-assigned meta- 



data label has a label identifier relating to emotional or 
aesth etic judgment of a user of the database; storing the 
database of pre-assigned metadata labels in a digital 
memory; displaying the collection of images that have 

5 been captured by the user, and a menu for selecting the 
pre-assigned metadata labels; selectively assigning at 
least one pre-assigned metadata label to at least one 
digital image in response to user's input; and storing the 
label identifier of the selected metadata label in associ- 

io ation with the selected digital image. 

[0006] The present invention has the advantage of al- 
lowing a user to preemptively categorize photos that are 
particularly noteworthy to the user. The application can 
display a menu of metadata labels, including labels such 

15 as "favorite photos", "funny photos", etc. The metadata 
labels, or alternatively metadata label identifier codes, 
are then stored within the image files and/or in a data- 
base separate from the image files, but referencing the 
appropriate images. At a later time, when the database 

20 contains hundreds or thousands of images, several 
metadata labels can be selected together to easily re- 
trieve images. For example, by selecting the categories 
"Matthew", Matthew's Birthday", and "favorite photos", 
the user can get a thumbnail display or slideshow of 

25 the "best" photos of Matthew taken on his birthday eve- 
ry year, rather than searching through a collection of 
hundreds or thousands of captured digital image files. 
[0007] These and other aspects, objects, features 
and advantages of the present invention will be more 

30 clearly understood and appreciated from a review of the 
following detailed description of the preferred embodi- 
ments and appended claims, and by reference to the 
accompanying drawings. 

[0008] Fig. 1 is an example flow diagram of the meth- 
35 od of this invention; 

[0009] Fig. 2 shows a block diagram of a system that 
implements this invention; 

[0010] Fig. 3 shows an example of a main user inter- 
face screen; 

40 [0011] Fig. 4 shows an example menu for selecting 
labels; 

[0012] Fig. 5 shows an example of the main user in- 
terface screen as labels are selected; 
[0013] Fig. 6 shows a user interface screen displaying 
45 a selected picture with its corresponding metadata la- 
bels; and 

[0014] Fig. 7 shows the user interface screen display- 
ing an image retrieved using selected labels. 
[0015] Referring to Fig. 1 a flow diagram of an exem- 

so piary embodiment of the present invention for adding 
personalized metadata to a collection of images is 
shown. Operation block 100 discloses a user inserting 
an auto-launch CD-ROM into a CO-ROM drive of a com- 
puter in order to install software that implements the 

55 method of the present invention. Operation 1 10 disclos- 
es prompting a user to create "labels" for their pictures 
(i.e., images), prior to capturing any images, for the pur- 
pose of locating (i.e., retrieving) the pictures at a later 
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time. An inquiry operation 120 asks the user to respond 
affirmatively or negatively. Should the user respond 
negatively, all operations cease. In contrast, should the 
user respond affirmatively, she would be prompted to 
enter nicknames of her family and friends by operation 
130. As will be described later, the user entries are 
prompted by questions including "please enter first 
names of family members and pets" and "please enter 
nicknames of friends you often photograph". Subse- 
quently, the user is prompted to either select or enter 
picture classifications, locations, and subjects accord- 
ing to operation 140. As will be described later, the user 
entries concerning classifications are prompted by 
questions concerning the types of situations and occa- 
sions that they generally photograph. 
[001 6] Operation 1 50 causes user labels to be stored 
in a metadata database. This completes the process of 
developing the database of pre-assigned metadata la- 
bels personalized for the particular user. Sometime later 
(e.g., immediately thereafter, or several hours later, or 
several days later), a user can capture one or several 
images and transfer the captured images to the compu- 
ter in operation 160. Upon transfer of the images in op- 
eration 160, operation 170 causes thumbnail images to 
be displayed. 

[0017] Operation 175 queries the user whether more 
labels should be added to the images. Simultaneously, 
operation 200 adds a selected label to metadata for all 
selected images. Operation 180 receives an affirmative 
response from the query of operation 175. The user se- 
lects one, many, or all of the images from the thumbnail 
display in operation 180. A final query operation 185 
asks whether the label is part of a pull down menu. An 
affirmative response is an input for operation 190, 
wherein the user selects a label by clicking on a menu 
item. Next, operation 200 adds the selected label to 
metadata for all selected images. A negative response 
the final query operation 185 causes operation 195 to 
prompt the user to enter in a label, which is then added 
to the metadata database. 

[0018] A negative response to query operation 175 
causes operation 210 to store metadata within each im- 
age file and in a separate database. Some time later (e. 
g., immediately thereafter, or many days later, or many 
years later), operation 220 prompts the user to select 
labels in order to retrieve images of interest. In the final 
operation 230, images with corresponding labels are re- 
trieved and viewed as thumbnails (so that the corre- 
sponding full resolution images can be selectively print- 
ed, transmitted, etc.) or may be viewed as a slide show. 
[0019] Fig. 2 is a block diagram of a digital imaging 
system useful in practicing the method of the present 
invention, which enables users to easily customize the 
interface and features of their digital camera prior to tak- 
ing pictures. The digital imaging system includes a dig- 
ital camera 10 which is supplied along with metadata 
categorization software provided on a compact disc, 
CD-ROM 32, a floppy disk 34, or other digital media. 



The digital imaging system also includes a host compu- 
ter 40, such as a Dell Dimension XPS M200, and a Net- 
work Service Provider 70. In accordance with one pre- 
ferred embodiment of the present invention, metadata 

5 categorization software is executed external to the dig- 
ital camera 10, and is executed on the host computer 
40. However, the metadata categorization software can 
alternatively be executed by an Internet appliance, set- 
top box, or other external device, or can be executed 

10 internal to the digital camera 1 0, provided that the digital 
camera has an appropriate user interface for displaying 
and responding to questions. The metadata categoriza- 
tion software can be provided along with the camera 
customization software described in commonly-as- 

15 signed U.S. Serial No. 09/549,356 filed April 14, 2000 
by Prabhu et al. 

[0020] The digital camera 10 produces digital images 
that are stored on a removable memory card 30 or other 
digital storage device. The digital camera 1 0 has a zoom 

20 lens 1 2 that is controlled by a zoom switch (not shown) 
having telephoto (T) and wide angle (W) positions, and 
having zoom and focus motor drives (not shown), and 
an adjustable aperture and shutter (not shown) for fo- 
cusing light from a scene onto an image sensor 14. The 

25 image sensor 14 can be, for example, a single-chip, 
colored, charge-coupled device (CCD), using the well- 
known Bayer colorfilterpattern. When the user depress- 
es a shutter button (not shown), the analog output signal 
from the image sensor 14 is converted to digital data by 

30 an analog-to-digital (A/D) converter 1 6. The digital data 
is processed by a processor 18 that is controlled by 
firmware stored in a reprogrammable memory, such as 
a Flash EPROM 28. 

[0021] The processed digital image file is provided to 

35 a digital storage interface 20 which stores the digital im- 
age file on the removable memory card 30, or on another 
type of digital memory device, such as a floppy disk or 
magnetic hard drive, or smart media. The removable 
memory card 30, which is well-known to those skilled in 

40 the art, can include, for example, a memory card adapt- 
ed to the PCMCIA card interface standard, as described 
in the PC Card Standard, Release 2.0, published by the 
Personal Computer Memory Card International Associ- 
ation, Sunnyvale, California, September 1991. The re- 

45 movable memory card 30 can also be adapted to the 
Compact Flash interface standard, such as described 
in the CompactFlash Specification Version 1.4, pub- 
lished by the CompactFlash Association, Palo Alto, Cal- 
ifornia, July 1999, or to other memory devices such as 

so the well-known SSFDC (Solid State Floppy Disc Card) 
or Memory Stick formats. 

[0022] The processor 18 performs color interpolation 
followed by color and tone correction, in order to pro- 
duce rendered sRGB image data. The processor 1 8 can 
55 include internal buffer memory to store a portion of the 
image, or to store one or more entire images. Alterna- 
tively, the processor 18 can use a separate external 
memory (not shown), such as DRAM memory. The ren- 
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dered sRGB image data is then JPEG compressed and 
stored as a JPEG image file on the removable memory 
card 30. The processor 18 also provides a lower reso- 
lution or "thumbnail" size image data to a color image 
display 22, such as a color liquid crystal display (LCD), 
which displays the captured image for the user to review. 
The low-resolution image can be created as described 
in commonly-assigned US Patent 5,164,831 issued No- 
vember 17, 1992 to Kuchta et al. Several camera user 
buttons 24 are used to control the digital camera 1 0. The 
camera user buttons 24, together with text and icons dis- 
played on the image display 22 (not shown), form the 
camera graphical user interface (GUI). This GUI is con- 
trolled by the user interface portion of the firmware 
stored in the Flash EPROM 28. 
[0023] The digital camera 10 determines various 
metadata items, such as the date/time the picture was 
taken from the real-time clock (not shown) provided by 
the processor 18, the camera lens settings, scene light 
level, etc. These metadata items are stored within a so- 
called "Exif" image file as defined in "Digital Still Camera 
Image File Format (Exif)" version 2.1, June 1998 by the 
Japan Electronics Industries Development Association 
(JEIDA), Tokyo, Japan. This format includes an Exif ap- 
plication segment that stores particular image metada- 
ta, for example the date and time the picture was cap- 
tured, the lens f/number and other camera settings. It 
can also include user-selected custom metadata labels, 
as will be described later. 

[0024] After a series of images has been taken by the 
digital camera 10 and stored on the removable memory 
card 30, the removable memory card 30 can be inserted 
into a memory card reader 48 attached to or incorporat- 
ed within the host computer 40. Alternatively, an inter- 
face cable 36 can be used to connect between a host 
interface 26 in the digital camera 10 and a camera in- 
terface 46 which may be external or internal to the host 
computer 40. The interface cable 36 may conform to, 
for example, the well-known universal serial bus (USB) 
interface specification. 

[0025] The captured images from the digital camera 
10 can be downloaded to the host computer 40 and 
stored on a hard drive 56 under the control of a central 
processing unit (CPU) 50. The CPU 50 is coupled to a 
display monitor 52, which is used to view the images, 
and a keyboard 54. A mouse 55 permits the user to read- 
ily communicate with the CPU 50. The CPU 50 commu- 
nicates with a CD Rom drive 42 in order to read the in- 
formation on the CD disc 32. The CPU 50 also commu- 
nicates with the floppy disk drive 44 in order to read the 
information on the floppy disk 34. The CPU 50 commu- 
nicates with a local printer 58, such as an Epson Stylus 
Photo 700 printer, which produces hard copy prints of 
the images that were captured by the digital camera 1 0. 
[0026] The digital camera 1 0 that is supplied to a user 
includes firmware that provides normal camera features 
and remains stored in the Flash EPROM 28. In an alter- 
native embodiment of the present invention, the user 



can customize the firmware stored in Flash EPROM 28 
of the digital camera 10 using the metadata categoriza- 
tion software provided with the digital camera 10, so that 
the metadata labels entered or selected by the user in 

5 blocks 130 and 140 of Fig. 1 are stored in Flash EPROM 
28. The color LCD image display 22 and user buttons 
24 are then used to assign metadata labels to images, 
substituting for blocks 175 through 210 of Fig. 1, as the 
images are captured or reviewed using the digital cam- 

io era 10. The CPU 50 uses the metadata categorization 
software in accordance with the present invention to 
provide custom metadata labels within the firmware 
code that is downloaded under the control of processor 
18 of the digital camera 10 via the removable memory 

*5 card 30, and stored in the Flash EPROM 28, as de- 
scribed in commonly-assigned US Patent 5,477,264 is- 
sued December 19, 1995 to Saibadhikari et al. or via 
the interface cable 36 as described in commonly-as- 
signed US Patent 5,734,425 issued March 31, 1998 to 

20 Takizawa et al. 

[0027] The metadata categorization software provid- 
ed on the CD-ROM disc 32 or the floppy disk 34 can 
also include digital image application software, such as 
the Picture Easy™ version 3.1 software developed by 

25 the Eastman Kodak Company. Alternatively, instead of 
being provided on a CD-ROM 32 or floppy disk 34, the 
metadata categorization software could be downloaded 
from the Network Service Provider 70 via a modem 60. 
The modem 60 communicates via a channel 64 with an- 
sa other modem 72 at the Network Service Provider 70, 
which is connected to a computer 74, and a customer 
image storage device or system 76. A billing system 78 
can charge the user (e.g., via a credit card) for down- 
loading the metadata categorization software. The com- 

35 puter 74 operates an application software database 80 
that can also provide input to one or more hardcopy 
printers 82 for subsequent printing of images captured 
by the digital camera 10. 

[0028] As shown in block 100 of Fig. 1, the user begins 

40 by installing the program on her computer. The program 
may be provided on a CD disc 32 which may be a Photo 
CD also having digitized images (so that the digital cam- 
era 10 is not needed), or can alternatively be included 
as part of application software provided with the digital 

45 camera 10. As part of this installation process, the user 
is prompted to answer a number of questions (blocks 
130 and 140 of Fig. 1) that produce a personalized da- 
tabase of metadata "labels". At least some of the data- 
base of metadata labels is derived from the user's emo- 

50 tional judgment about the content of the images that she 
usually captures. The present invention allows a user to 
develop emotional or aesthetic based metadata that is 
useful in categorizing several of the user's captured im- 
ages according to the user's own emotional or aesthetic 

55 judgment regarding the captured images. 

[0029] The emotional or aesthetic based metadata is 
derived from a user answering queries about her family, 
friends, and her aesthetic judgment of the typical images 
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that she captures. Consequently, the user is able to 
preemptively categorize "how much they like a picture" 
by using emotional or aesthetic based metadata labels 
such as "favorite photos", "best photos", "cute photos", 
"important moments", or "funny photos." These meta- 
data labels are then stored within the captured image 
files and/or in a database that may be separate from the 
image files, but still references the appropriate catego- 
rized images. Labels assigned to each digital image file 
may be stored as ASCII text strings or as other types of 
metadata label identifiers, such as digital code values 
assigned to a particular metadata label. For example, a 
user's "best" pictures may be stored with the ASCII text 
"BEST", for "user image value", or may be stored with 
the digital value "10" (using a 10 point scale where 1 is 
lowest and 1 0 is highest) as the metadata label identifier 
in the "user image value" field. After describing how the 
answers will be used, the following types of personal 
queries may be asked: 

• Type the nicknames of immediate family members 

• Type the nicknames of friends you often photograph 

• Are these good ways to classify your pictures? (se- 
lect, deselect, or add) 

• Best photos, funny photos, cute photos, im- 
portant moments 

• Where do you often take pictures (select, deselect, 
or add) 

• Our house, our yard, (friend's name's house), 
zoo, park, etc. 

• What type of pictures do you often take (select, 
deselect, or add) 

• Portraits, landscapes, flower & plants, sports 

[0030] In block 150, the user's responses to these 
questions are used to configure and store a database 
of pre-assigned metadata labels for the user in a digital 
memory, normally hard drive 56 of computer 40. 
[0031] In block 160, the user then proceeds to use the 
metadata categorization software to display images ei- 
ther stored in or downloaded from the digital camera 10, 
or provided from a Picture CD 32, or another image 
source. For example, in block 130 to 140 of Fig. 1, the 
user may develop metadata labels that relates to family 
members, that family member's birthday party, as well 
as emotional metadata labels, for example images that 
the user 'feels' are her favorite photos. For an explicit 
example, a user selects categories labeled "Matt", 
"Matt's Birthday", and "favorite photos". Adding labels 
to the appropriate images as part of blocks 175 through 
210 of Fig. 1 will enable the user to later (in blocks 220 
through 230) quickly and easily access a thumbnail dis- 
play or slideshow of the "best" photos featuring Matt tak- 
en on his birthday every year that pictures were taken, 
rather than searching through a collection of hundreds 
or thousands of captured digital image files taken over 
many years. 

[0032] As part of block 1 60, the images from the cam- 



era (or full size or thumbnail size images from the Pho- 
toCD) are transferred to the computer hard drive 56. In 
block 170, the CPU 50, running the metadata categori- 
zation software displays thumbnail size images of each 

5 new downloaded picture on the computer monitor, as 
depicted in Fig. 3, along with a message such as "Label 
your photos now, so you can find them later". The user 
selects one, several, or all of the thumbnail images by 
clicking on the images. The user then selects, from a 

10 pull-down menu, a metadata category (e.g., "People - 
who's in the picture", "Subject - who's in this picture ", 
'Type - What type of picture is this?" Then, for the se- 
lected category, they select one or more metadata items 
using blocks 175 through 200 of Fig. 1 . For example, if 

* 5 they select "Subject - who's in this picture, the applica- 
tion may display a menu listing " Ken, Susan, Matthew, 
JoAnn, etc." and allow them to click on one or more 
names. If necessary, they can type in new names (block 
195 of Fig. 1), which are added to future display lists. 

20 When the user selects "Type - what type of picture is 
this", the application displays a menu including a 
number of emotional or aesthetic categories such 
as "best photos", "funny photos", etc." 
[0033] Example display and pull-down menu embod- 

25 iments for blocks 175 through 200 of Fig. 1 are shown 
in Figs. 3-6. Referring to Fig. 3, a "Main User Interface 
Screen" 3000 includes the following toolbar buttons: an 
"Add Label" 3010, a "Show labels" 3020, a "Find with 
Labels" 3030, a "Slide Show" 3040, and a Transfer Pic- 

30 tures" 3050. The main user interface screen 3000 has 
a slider or scrollbar 3060 for scrolling up and down 
through a group of thumbnail images. Many thumbnail 
images 3070 (e.g. 1 6 thumbnail images) may be dis- 
played for the user to view and choose. 

35 [0034] The interface screen shown in Fig. 3 provides 
an efficient way for the user to enter metadata for imag- 
es, a "group" of thumbnails at a time. A typical digital 
memory card 30 can contain, for example, 24 pictures 
taken over 3 "picture taking sessions". For example, 

40 over the course of a weekend, the group of images on 
the digital memory card 30 may include 12 shots taken 
at Matthew's birthday party at home, 8 shots taken dur- 
ing a visit to the zoo, and 4 taken during a stop at 
JoAnn's house. The thumbnail images 3070 shown in 

*5 Fig. 3 are 1 6 images from this set, corresponding to the 
position of scroll bar 3060 within the set of images. The 
thumbnail images 3070 are provided using the thumb- 
nail image data stored within the Exif image file. The 
date each image was taken is also read from the Exif 

so image file metadata and displayed beneath each image. 
In order to label images, the user selects the "add label" 
icon 3010. 

[0035] Referring to Fig. 4, a screen entitled, "Menu for 
Selecting Labels" 4000 lists an example of pre-assigned 
55 metadata labels configured in blocks 130 to 150 of Fig. 
1, which can now be selected by the user in block 190 
of Fig. 1 . The list includes the following menu selections: 
an "Add Label" 4010, a "People" 4020, a "Places" 4030, 
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a "Subjects" 4&40, a "Types'* 4050. At the next level, the 
selections correspond with the user's input to the previ- 
ous selections. For example selection 4060 corre- 
sponds with the user's input to menu selection 4020 (e. 
g. the list of family members and friends that are often 
photographed). Selection 4070 corresponds to the user 
input for menu selection 4030. Selection 4080 corre- 
sponds to the user input for menu selection 4040. Se- 
lection 4090 corresponds to the user input for menu se- 
lection 4050. One of ordinary skill can envision further 
levels as well. 

[0036] Referring to Fig. 5, a display screen 5000 
showing how the "main user interface screen labels are 
selected" is disclosed. A user selects "Add Label" 3010, 
and uses the pull down menu to select "People" 4020, 
whereby a second pull down menu with the user's input 
4060 is shown. The display includes a scroll bar 3060 
and several thumbnail images 3070 as well as icons or 
text 5010 that indicate which of the thumbnail images 
3070 have associated metadata labels. 
[0037] Fig. 6 displays a screen 6000 that depicts a se- 
lected picture 6020 with its associated metadata labels 
6010. The current labels 6010 correspond to the labels 
selected during steps 175 through 200 of Fig. 1. The 
selected picture 6020 includes the labels 6010 "Mat- 
thew" (people), "Ken" (people), "Our backyard" (place), 
"Flowers" (subjects) and "Best photos" (type). 
[0038] In block 180, the user selects one or more 
thumbnail images using the thumbnail images 3070. For 
example, the user can quickly highlight the first 12 im- 
ages, and then select (in block 190) Event Matthew's 
birthday to label all of these images using the list shown 
in Fig. 4, and proceed to highlight and label the other 
groups if they wish (repeating blocks 175 through 200 
of Fig. 1). As another example, also shown specifically 
in Fig 5, in block 180 of Fig. 1 the user can highlight all 
the images on the roll with one click, deselect those few 
that do not include Matthew, and then select People -> 
Matthew in block 190 to further label the appropriate im- 
ages. As another example, in block 180 the user can 
highlight the one or two of the pictures they judge to be 
their very best images of the group, and select Type -» 
Best Photos in block 190. If an appropriate label does 
not exist, the user can create a new label in block 195, 
which is stored in the metadata label database for future 
use. 

[0039] As labels are added to each image, graphics 
6010 (or text) coded to indicate the category of labels 
provided for the image, are positioned in the corner of 
the corresponding thumbnail image display, as shown 
in Fig. 6. When the "show labels" button 3020 is selected 
by the user, the labels are displayed adjacent to the se- 
lected image, so that it is apparent what labels have 
been applied to a particular image, as shown in Fig. 5. 
In this mode, the user can also add additional labels or 
change previous-applied labels for that particular im- 
age. 

[0040] In block 210, the metadata text labels or other 



metadata label identifiers are then stored within the im- 
age files and/or in a database separate from the image 
files. At a later time, when the database contains hun- 
dreds or thousands of images, the metadata can be 

5 used to easily retrieve images. Fig. 7 discloses a "Find 
with Labels" feature 7000 that allows a user to locate 
images using the pre-assigned metadata labels config- 
ured in blocks 130 through 150 of Fig. 1 and assigned 
to particular images in blocks 175 through 210 of Fig. 1 . 

10 Toolbar button "Find with labels" 3030 is selected. The 
user then selects, from the menu depicted in Fig. 4, la- 
bels of interest, for example the labels "Matthew", "Zoo", 
and "Best photos" 7020 . A scroll bar 3060 allows a user 
to scroll the images 7040 found by the label search. In 

'5 the example of Fig. 7, by selecting the categories "Mat- 
thew", "Zoo", and "Best photos", the user can get a 
thumbnail display or slideshow of the best photos fea- 
turing Matt taken on his birthday over the course of sev- 
eral years, ratherthan searching through a collection of 

20 hundreds or thousands of digital image files stored on 
hard drive 56. 

[0041] In an alternative embodiment, blocks 170 
through 210 of Fig. 1 are implemented in the digital cam- 
era 10 of Fig. 2. In another alternative embodiment, the 

25 user identifies only certain types of images, such as fa- 
vorite images, important events, or funny images, when 
the images are captured on digital camera 10, by select- 
ing the appropriate labels using user buttons 24 while 
reviewing captured image thumbnails on the color LCD 

30 image display 22. The metadata labels associated with 
these emotional or aesthetic judgements are then 
stored within the Exif image files. Additional metadata 
labels can optionally be added when these images are 
transferred from the digital camera 10 to the computer 

35 40, as described earlier in relation to blocks 1 70 through 
210 of Fig. 1. 

[0042] Computer program products, such as readable 
storage medium, can be used to store the customization 
software, and also the desired firmware components in 

40 accordance with the present invention. The readable 
storage medium can be a magnetic storage media, such 
as a magnetic disk (such as a floppy disk) or magnetic 
tape; optical storage media, such as an optical disk, an 
optical tape, or a machine readable barcode; solid state 

^5 electronic storage devices, such as a random access 
memory (RAM) or a read only memory (ROM); or any 
other physical device or medium employed to store 
computer programs. 

50 

Claims 

1 . A method for adding personal image metadata to a 
collection of images comprising the steps of: 

55 

(a) configuring, in response to user's answers 
to predetermined queries prior to image cap- 
ture, a database of pre-assigned metadata la- 



11 EP 1 209 589 A2 12 

bels Oseful fordassifying future images, where- 
in at least one pre-assigned metadata label has 
a label identifier relating to emotional or aes- 
thetic judgment of a user of the database; 

(b) storing the database of pre-assigned meta- 5 
data labels in a digital memory; 

(c) displaying the collection of images that have 
been captured by the user, and a menu for se- 
lecting the pre-assigned metadata labels; 

(d) selectively assigning at least one pre-as- to 
signed metadata label to at least one digital im- 
age in response to user's input; and 

(e) storing the label identifier of the selected 
metadata label in association with the selected 
digital image. 15 

2. The method claimed in claim 1 , further comprising 
the step of 

(0 selecting at least one pre-assigned metada- 20 
ta label, in response to the user inputs; 
(g) searching the collection of digital images to 
retrieve at least one image having the selected 
pre-assigned metadata label. 



25 



30 



The method claimed in claim 1 , wherein the meta- 
data label includes one type of label indicating that 
the image is a member of a category selected by 
the user. 

The method claimed in claim 1 , wherein the method 
is practiced by a digital camera. 



5. The method claimed in claim 1 , wherein the prede- 
termined queries include at least one of : 35 

a) "Where do you often take pictures?" 

b) " What type of pictures do you often take?" 

c) "What are your nicknames for immediate 
family members?" 40 

d) "What are your nicknames of friends that you 
photograph?" 

e) "Are these good ways to classify your pic- 
tures?", and 

f) "My best photos, funny photos, cute photos, *5 
important moments". 

6. An image categorization system, comprising: 

a) a memory device that digitally stores a col- so 
lection of captured images; 

b) means for inputting a user's personal captur- 
ing information; 

c) means for viewing the collection of captured 
images on a display device; and 55 

d) means for labeling the collection of captured 
images with the user's personal capturing infor- 
mation. 
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